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Abstract 


We  describe  an  algorithm  for  the  asymmetric  traveling  salesman 
problem  (TSP)  using  a new,  restricted  Lagrangean  relaxation  based  on  the 
assignment  problem  (AP) . The  Lagrange  multipliers  are  constrained  so  as 
to  guarantee  the  continued  optimality  of  the  initial  AP  solution,  thus 
eliminating  the  need  for  repeatedly  solving  AP  in  the  process  of  computing 
multipliers.  We  give  several  polynomially  bounded  procedures  for 
generating  valid  inequalities  and  taking  them  into  the  Lagrangean  function 
with  a positive  multiplier  without  violating  the  constraints,  so  as  to 
strengthen  the  current  lower  bound.  Upper  bounds  are  generated  by  a fast 
heuristic  whenever  possible.  When  the  bound-strengthening  techniques  are 
exhausted  without  matching  the  upper  with  the  lower  bound,  we  branch  by 
using  two  different  rules,  according  to  the  situation:  the  usual  subtour 
breaking  disjunction,  and  a new  disjunction  based  on  conditional  bounds. 

We  discuss  computational  experience  on  120  randomly  generated  asymmetric 
TSP's  with  up  to  325  cities,  the  maximum  time  used  for  any  single  problem 
being  82  seconds.  Though  the  algorithm  discussed  here  is  for  the  asymmetric 
TSP,  the  approach  can  be  extended  to  the  symmetric  TSP  by  using  the 
2-matching  problem  instead  of  AP. 


1 . Outline  of  the  Approach 


The  traveling  salesman  problem  (TSP),  i.e.,  the  problem  of  finding  a 
minimum-cost  tour  (or  hamiltonian  circuit)  in  a directed  graph  G = (N,A), 
can  be  formulated  as  the  problem  of  minimizing 


(1) 

•j 

E £ cijxij 

icN  j«N  J J 

subject  to 

i 

S’  E x - 1,  i e N 

j j*N 

(2) 

| 2 xn  = !,  J «N 

V.  i«N  J 

, (3) 

Xij  * i.j  eN 

(4) 

x is  a tour . 

For  (i,j)eA,  c^  is  the  cost  associated  with  the  arc  (i,j);  for 
(i,j)  i A,  ctj  - ». 

Conditions  (3),  (4)  can  be  replaced  by 

(5)  x^  > 0,  i,j  eN 

(6)  I Z ajx  >aj,  tcQ 
icN  jcN  1J  J u 

where  (6)  is  a set  of  inequalities  which,  together  with  (2)  and  (5), 
define  the  convex  hull  of  all  tours  in  G. 

If  S and  T are  node  sets,  we  denote  (S,T)  - [(i,j)  eA  | icS,  J«t}. 

For  any  problem  P,  we  denote  by  v(P)  the  value  of  (an  optimal  solution  to)  P. 

We  describe  an  arc  premium/ penalty-based  branch  and  bound  method  for 
solving  TSP,  which  uses 

(a)  a new  Lagrangean  relaxation  of  TSP  and  a restricted  Lagrangean 


problem  derived  from  It,  which  has  constraints  on  the  multipliers; 
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(b)  several  procedures  for  generating  inequalities  which  can  be  taken 
into  the  Lagrangean  function  with  a positive  multiplier  (premium  or  penalty), 
without  violating  the  constraints  or  changing  the  multipliers  generated  earlier; 

(c)  a new  branching  rule  based  on  disjunctions  derived  from  conditional 
bounds . 

We  first  outline  the  method,  then  discuss  its  various  components  in 
detail . 

The  assignment  problem  (1),  (2),  (5)  associated  with  TSP  will  be 
denoted  by  AP . It  is  well  known  that  any  integer  solution  to  AP  is  either 
a tour  (hamiltonian  circuit),  or  a collection  of  subtours  (a  union  of  dis- 
joint circuits).  The  Lagrangean  problem  mentioned  under  (a)  is  an  assign- 
ment problem  obtained  from  AP  by  applying  premia  or  penalties  to  certain 
arcs,  in  a way  which  is  equivalent  to  taking  into  the  objective  function, 
in  a Lagrangean  fashion,  some  of  the  constraints  (6). 

From  the  set  of  inequalities  (6)  we  extract  a subset 


(7) 


S I aj  x > aj,  t c T c Q 
icN  jcN 


and  call  LP  the  linear  program  (1),  (2),  (5),  (7).  Though  the  set  Q is  at  least 
exponential  in  |n| , empirical  evidence  as  well  as  theoretical  considerations 
indicate  that  there  are  relatively  small  subsets  T of  Q such  that  the  value 
of  the  corresponding  LP  comes  very  close  to  (or  coincides  with)  that  of  TSP. 

Using  Lagrangean  relaxation  on  (7)  and  denoting  by  w the  vector  of 
Lagrange  multipliers , we  obtain  the  problem  L(w,x),  equivalent  to  LP,of 
finding  w > 0 to  maximize  z(w),  where 


a'  > *<»>  - z z - z Vu>xu  + A.  Vo- 

i*N  jcN  J tcT  J J tcT 


subject  to 


I x - 1,  i cN 
j«N 


(2) 

(5) 


L x.  . - 1,  JcN 


IcN 


iJ 


x!j  > °*  *-.J  «N- 


• 1 
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The  Lagrangean  relaxation  L(w,x)  of  TSP  can  be  used  to  generate  lower 
bounds  on  v(TSP).  While  L(w,x)  may  yield  very  strong  bounds  indeed, 
depending  on  the  choice  of  the  inequalities  (6),  its  solution  via,  say, 
subgradient  optimization,  requires  a considerable  computational  effort, 
including  the  solution  of  the  assignment  problems  associated  with  every 
vector  w generated  during  the  procedure.  Instead,  we  consider  a restriction 
RL(w,x)  of  the  Lagrangean  relaxation  L(w,x).  Let  x be  an  optimal  solution  to 
AP,  i.e.,  to  the  assignment  problem  with  cost  function  (1).  RL(w,x)  is  then 
the  problem  of  finding  w > 0 to  maximize  z(w)  defined  by  (1'),  (2)  and  (5), 
subject  to 


(8) 


Ui  + vj  + 


t«T 


Wtaij 


’ij 


^Cij 


if  xtj  > 0 


if  x 


ij 


for  some  u,v  c Rn. 

Problem  RL(w,x)  has  two  properties  which  make  it  useful  towards 
solving  TSP. 

First,  any  u,  v and  w satisfying  (8)  and  w > 0 is  a feasible  solution 
to  the  linear  program  dual  to  LP;  therefore  the  objective  function  value 
of  this  dual  linear  program  is  a lower  bound  on  v(LP),  hence  on  v(TSP), 
i.e.,  we  have 


Proposition  1.  If  u,  v and  w > 0 satisfy  (8),  then 

(9)  I u + Z $ + Z wa*<v(TSP). 

i*N  jtN  J t«T 

Second,  while  x remains  an  optimal  solution  to  the  assignment  problem 
with  the  modified  objective  function  (l'),  the  changes  brought  about  by 
the  penalties/premia  v*t,  t e T,  are  likely  to  create  new,  alternative  optima. 
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Whenever  such  an  alternative  optimal  solution  x to  the  assignment  problem 
(1  )>  (2),  (5)  turns  out  to  be  a tour,  it  has  the  following  property. 

Proposition  2.  if  x satisfies  with  equality  the  inequality  (7)  indexed 
by  t for  all  t cT  such  that  wt  > 0,  x is  an  optimal  tour. 

Proof,  x and  (u,v,w)  are  feasible  solutions  to  LP  and  its  dual, 
respectively.  From  the  definition  of  x,  we  have 


ui  + VJ  + 4 Vij  - cij 

whenever  x^  > 0.  Ihis , together  with  the  condition  of  the  Proposition, 
means  that  x and  (u,v,w)  satisfy  the  complementary  slackness  conditions. 
Thus  x is  an  optimal  solution  to  LP,  hence  an  optimal  tour.|j 

We  start  by  solving  the  assignment  problem  AP  in  the  free 
variables  . Next  we  use  several  different  procedures  for  generating  an 
increasing  sequence  of  lower  bounds  on  v(TSP),  by  successively  identifying 
Inequalities  (7)  that 

(i)  are  not  satisfied  by  the  current  solution  x to  AP , and 

(ii)  admit  a positive  multiplier  w£  which,  together  with  the 
multipliers  already  assigned,  satisfies  (8); 

and  by  setting  the  multipliers  w£  each  time  to  the  greatest  positive 
value  compatible  with  (ii).  At  any  given  stage,  the  admissible  graph 
Gq  - (N,Aq)  is  the  spanning  subgraph  of  G containing  those  and  only 
those  arcs  with  zero  reduced  cost,  l.e., 

A0  “ {(i.J)  «A  | u + v + 2 Vil’ci1^ 

j tfT  j j 

When  no  more  inequalities  (7)  satisfying  conditions  (i)  and  (ii) 
can  be  found,  we  store  the  bound  given  by  (9)  and  try  to  find  a tour  in 


i 
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the  admissible  graph.  If  a tour  is  found  which  satisfies  with  equality 
all  inequalities  associated  with  positive  multipliers,  it  is  optimal  for 
the  given  subproblem.  If  a tour  is  found  which  violates  this  condition 
for  some  inequalities,  attempts  are  made  at  finding  new  inequalities 
which  satisfy  the  condition  and  admit  positive  multipliers.  If  sufccessful, 
these  attempts  strengthen  the  lower  bound,  and  they  may  also  eliminate  the 
inequalities  that  are  slack.  In  any  case,  the  value  of  the  tour  (in  the 
original  costs  c.  ) provides  an  upper  bound  on  v(ISP),  while  (9)  provides 
a lower  bound  for  the  current  subproblem;  and  we  branch.  Finally,  if  no  tour  is 
found  in  Gq,  we  add  arcs  to  in  the  order  of  increasing  reduced  costs  until 
a tour  is  found  in  the  resulting  graph.  The  cost  of  this  tour  again  provides 
an  upper  bound  on  v(TSP) , while  (91  still  provides  a lower  bound  for  the 
current  subproblem;  and  we  branch. 

The  assignment  oroblems  are  solved  by  the  Hungarian  method,  the 
same  method  is  used  to  recalculate  the  reduced  costs  whenever  some  u^  and 
Vj  have  to  be  changed.  The  constraints  (7)  are  "subtour-breaking" 
inequalities  and  combinations  of  the  latter  with  some  of  the  equations 
(2),  but  they  are  used  here  in  a novel  way.  The  bounding  procedures  are  all 
polynomial- time  algorithms,  considerably  more  efficient  (in  terms  of  improvement 
obtained  versus  computational  effort)  than  earlier  approaches  (like  [3]),  as 
evidenced  by  the  computational  results  of  section  5.  Searching  the  admissible 
graph  Gq  for  a tour  is  accomplished  by  a specialized  implicit  enumeration 
procedure,  with  a cut-off  rule.  Finally,  for  branching  we  use  two  different 
rules,  one  which  derives  a disjunction  from  a conditional  bound  [1],  and  one 
which  breaks  up  a subtour. 

A preliminary  version  of  our  approach,  with  fewer  and  less  sophisticated 
bounding  procedures,  was  discussed  in  [2]. 
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2.  Bounding  Procedures 


At  any  stage  of  the  procedure,  the  reduced  costs 


— c 

C — C -11  — V - L u 3 

cij  cij  ui  vj  t“T,  Vij 

will  be  defined  relative  to  the  subset  T/  cT  of  inequalities  already 

introduced  into  the  function  (l' ). 

We  use  three  types  of  inequalities  (7),  and  we  will  denote  by  T^, 

and  Tj  the  corresponding  subsets  of  T. 

For  t e T,  let  0 ji  S„£N  and  S = N\S  . An  arc  set  of  the  form 
t t t 

Kt  - CSt.St> 

is  called  a (directed)  cutset . 

Clearly, the  inequalities 

(7a)  E x > 1,  t e T. 

(i,j)«Kt  1J 

are  satisfied  by  every  tour,  and  so  are  the  inequalities 


(7b') 


2 2 *tJ  < |St|  - 1, 

icSt  j«St  1J 


or,  to  preserve  the  direction  of  the  inequality, 


-2  2 x > 1 - | S | , 

ieSc  jeSt 


teTj. 


For  a given  set  St,  the  "sub tour -breaking"  inequalities  (7a)  and  (7b) 
are  equivalent:  (7b)  can  be  obtained  from  (7a)  by  subtracting  the  sum  of 


the  equations 


2 x - 1,  i tS  , 
j*N  J 


and  (7a)  can  be  obtained  from  (7b)  by  the  reverse  operation.  Nevertheless, 
the  presence  of  inequalities  associated  with  the  same  set  in  both 
subsets  (7a)  and  (7b)  need  not  be  avoided,  since  it  may  enrich  the  set  of  dual 
vectors  (u,v,w)  satisfying  (8)  and  w > 0. 


Finally,  for  any  ktN,  St  C N \ {k}  and  §t  = N\St>  the  arc  sets 


= (st  \ C k }}  and  k£  = (St\{k},St) 

are  (directed)  cutsets  in  the  subgraph  <^N\{k  })  of  G induced  by  N\{k  }. 
Proposition  3.  The  inequalities 


(7c)  I!  x.  . > 1 , tel, 

(i,j)«K'UK"  1J 

are  satisfied  by  every  tour. 

Proof . Every  xg  [0,l}n  that  violates  (7c)  corresponds  to  a subgraph  G ' 
of  G which  is  either  disconnected,  or  contains  an  articulation  point  k ; 
hence  G7  cannot  be  a tour.|j 

Actually,  more  can  be  said  about  the  family  (7c): 

Proposition  4.  In  the  presence  of  the  constraint  set  (2),  for  every 
k sN  and  StcN\[k],  the  inequality  (7c)  is  implied  by  the  two  subtour-breaking 
inequalities  associated  with  the  node  sets  S t U f k } and  St  respectively,  i.e.,  by 


(7b)x 

and 


E E x > 

ieStU  {k}  j cS t U [k]  ij 


(7b)2 


- E E x > 1 - |S  |. 

ieSt  jcSt 


Proof . The  inequality  (7c)  is  the  sum  of  (7b )^,  (7b  )^  and  the 
equations 

E x,  , * 1 , i e S . 

jcN  J 

£ xt,  - 1 , j «S  -|| 

icN  J 

The  components  of  w associated  with  the  inequalities  (7a),  (7b),  and 


(7c)  will  be  denoted  by  \ , p,  and  v respectively. 
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2.1.  Bounding  Procedure  1 starts  by  searching  for  an  inequality  (7a)  which 
satisfies  conditions  (i),  (.. ) of  section  1,  i.e.,  is  violated  by  x and 
can  be  assigned  a positive  multiplier  without  making  any  of  the  reduced 
costs  negative.  Clearly,  these  conditions  are  satisfied  for  the  inequality 
(7a)  defined  by  a cutset  Kt>  if  and  only  if 

(10)  Kt  n Aq  = 0, 

where  Aq  is  the  arc  set  of  the  admissible  graph  Gq. 

To  find  satisfying  (10),  we  choose  any  node  ieN  and  form  its 
reachable  set  R(i)  in  Gq.  If  R(i)  = N,  there  is  no  cutset  (S,S)  with  i eS, 
satisfying  (10),  so  we  choose  another  ieN.  If  for  some  ieN,  R(i)  t N,  then 
= (S^,S^_)  satisfies  (10)  for  S = R(i).  Furthermore, 

(11)  \ - min  c 

(i,j)*Kt  1J 

is  clearly  the  largest  value  that  can  be  assigned  to  the  corresponding 
multiplier  without  making  some  reduced  costs  negative.  We  thus  assign 
\ the  above  value  and  set 

Cij  “ Cij  ' Xt’  eKt’ 

i.e.,  we  apply  a premium  of  \ to  each  arc  of  the  cutset  Kt . As  a result 
of  this,  the  arcs  for  which  the  minimum  in  (11)  is  attained,  become 
admissible,  and  we  add  them  to  Aq,  thus  enlarging  the  admissible  graph  Gq. 

Next,  we  extend  the  reachable  set  R(i)  of  node  i by  using  the  new 
arcs  of  Gq  and  either  find  R(i)  = N,  or  locate  another  cutset  Kt  satisfying 
(10).  If  R(i)  3 N,  again  we  choose  another  node. 

This  procedure  ends  when  R(i)  » N,  V ieN.  At  that  stage  'q  is 
strongly  connected,  and 

K n Aq  + 0 

for  all  cutsets  K = (S,S),  ScN. 


Proposition  5.  Sounding  Procedure  1 stops  after  generating  at  most 


|(h 


l)(h+2)  cutsets,  where  h is  tJ"  number  of  subtours  in  x. 


Proof  Starting  with  node  i^  belonging  to  subtour  S^,  every  cutset  adds  to  Gq 
an  arc  which  includes  into  R(i^)  a new  subtOur.  After  generating  at  most  h-1  cut- 
sets, R(i^)=N.  Now  starting  with  node  i?  belonging  to  subtour  and  proceeding 

to  find  RC^) , again  at  most  h-1  cutsets  can  be  generated.  However,  since  we  now 
have  i?e  R(i^)  and  i^e  RC^) , the  number  of  strong  components  of  the  current 
graph  Gq  is  at  most  h-1.  Thus,  continuing  to  find  R(i^)  for  some  node  i^ 
belonging  to  a subtour  S^,  at  most  h-2  cutsets  can  be  generated, 

and  since  the  vertices  of  S^,  and  now  form  a strong  component,  the 
number  of  strong  components  in  the  current  graph  G^  is  at  most  h-2.  Continuing 
in  the  same  way,  the  number  of  cutsets  generated  by  the  procedure  (until  G^ 
becomes  strongly  connected)  is  at  most 

(h-1)  + (h-1)  + (h-2)  + (h-3)  +...+  1 = |(h-l)(h+2). || 

Since  the  optimal  dual  variables  u^,  v^  associated  with  x are  not 

changed  by  this  procedure,  and  since 


Z u + Z v.  = cx  = v(AP), 
i*N  1 j6N  J 

if  is  the  index  set  of  the  inequalities  generated  by  Bounding  Procedure  1,  the 
lower  bound  obtained  for  the  current  subproblem  is,  from  Proposition  1, 

(12)  Bl  = v(AP)  + 2 \t. 


2-2-  Bounding  Procedure  2 starts  by  searching  for  an  inequality  (7b)  which 
is  violated  by  x and  admits  a positive  penalty  without  changing  any  of  the 
\t>  t eT^.  If  are  the  node  sets  of  the  h subtours  of  x,  every 

inequality  (7b)  defined  by  St,  t = l,...,h,  is  violated  by  x;  but  a positive 
penalty  u can  be  applied  without  violating  the  condition  that  x. . > 0 

**  1 J 

implies  c„  = 0,  only  by  changing  the  values  of  some  u^  and  v^ , and  only  if 
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an additional  condition  is  satisfied.  This  condition  can  best  be  expressed 
in  terms  of  the  assignment  tableau  used  in  conjunction  with  the  Hungarian 
method.  A line  of  the  tableau  is  a row  or  a column,  a cell  of  the  tableau 
is  the  intersection  of  a row  and  a column.  Cells  correspond  to  arcs  and 
are  denoted  the  same  way. 

Let  St  be  the  node  set  of  a subtour  of  x,  let 

At  = { (i,  j)  eAQ  | i,  j e St} 

and 

A't  = C (i  , j ) e At  | x^  > 0}. 

Proposition  6.  A positive  penalty  can  be  applied  to  the  arcs  with 
both  ends  in  S if  and  only  if  there  exists  a set  C of  lines  such  that 

(i)  every  (i,j)  eA't  is  covered  by  exactly  one  line  in  C, 

(ii)  every  (i,j)eAt\A^  is  covered  by  at  most  one  line  in  C, 

(iii)  no  (i,j)  sAqXAj.  is  covered  by  any  line  in  C. 

If  such  a set  C exists,  and  it  consists  of  row  set  I and  column  set  J, 
then  the  maximum  applicable  penalty  is 

(13)  Ij,  = min  c , 

(i , j )cM 

where 

(14)  M = (I.J)  U (I,St)  U (St,J). 


Proof . Sufficiency.  Suppose  there  exists  a line  set  C,  consisting 
of  row  sets  I and  column  sets  J,  satisfying  conditions  (i),  (ii),  (iii). 
Then  adding  an  amount  p > 0 to  c^  for  all  (i,j)  e (St>St),  as  well 
as  to  all  Uj , icl,  and  all  v , j s J,  produces  a set  of  reduced 
costs  c(^  such  that  c^  = 0 for  all  (i,j)  e A't , since  C - IUJ  satisfies 
Further,  from  property  (ii)  of  the  set  C,  c^  > 0,  V (i,j)  eA^XA^;  and 


(i). 

from 


A 
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(iii),  = c = 0,  V (i,j)  e aq • Thus  the  only  reduced  costs 

that  get  diminished  as  a result  of  the  above  modification,  are  those 

associated  with  arcs  (i,j)  CA  for  which  either  (or)  nothing  is  added  to 

c.  and  p is  added  to  u.  or  to  v ■ or  (0)  p is  added  to  c. . and 
ij  i j ^ i j 

to  both  u^  and  v ^ . The  two  sets  of  arcs  for  which  (q)  holds 

are  (I,S  ) and  (§t , J)  ; whereas  the  arc  set  for  which  (fS ) holds  is  (I,J). 

The  union  of  these  three  arc  sets  is  M defined  by  (14).  Thus  a positive 
penalty  at  most  equal  to  p defined  by  (13)  can  be  applied  to  the  arc  set 
(S  ,S  ) in  the  above  described  manner  without  producing  any  negative  reduced 
costs . 

Necessity.  Suppose  a penalty  p > 0 can  be  applied  to  the  arc  set 
(St,St).  Since  adding  p > 0 to  c , V (i,j)  e (St,St),  produces  positive 
reduced  costs  for  all  (i,j)  eA^,  in  order  to  obtain  reduced  costs  = 0 
for  all  (i,j)  eA^,  one  must  increase  by  p the  sum  u^  + v^  for  all  (i,j)eA^. 

It  is  easy  to  see  that  if  this  can  be  done,  then  it  can  be  done  by  adding  p to 
u^  or  Vj  (but  not  to  both),  for  every  (i,j)eA^';  hence  there  exists  a set  C of 
lines  satisfying  condition  (i)  . Further,  if  (i,j)  f A^^,  then  p cannot  be  added 
to  both  Gi  and  v without  creating  c| ^ < 0,  hence  C must  satisfy  (ii)  . Finally, 
if  (i,j)  e A^xA^  then  p cannot  be  added  to  either  u^  or  v^  without  making  c^  < 0, 

hence  condition  (iii)  must  also  hold . || 

Given  the  node  set  S of  a subtour,  we  have  to  check  whether  a set 

of  lines  C satisfying  (i),  (ii),  (iii)  exists.  This  can  be  done  as  follows. 

First,  every  row  i eSt  such  that  (i,j)  cAQ  for  some  j eN\Sc>  and 
every  column  j cSt  such  that  (i,j)  eAQ  for  some  i eN\St>  can  be  ruled  out 
as  a candidate  for  entering  C.  Let  R and  K be  the  index  sets  of  such 
rows  and  columns  respectively,,  and  let 

IT  = (i«N| (i, j) *a'  and  j*K}, 

Jx  = £ j eN | ( i , j ) eA^  and  ieR}. 
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P 


► 


* 


Since  by  (i)  every  cell  of  A^  must  be  covered  by  at  least  one  line  In  C, 

C must  contain  I.£JJ^.  For  the  same  reason,  If 

(15)  A ' n R (1  K M 

then  no  positive  penalty  can  be  applied  to  the  arc  set  (S^.S^). 

Since  by  (1)  and  (ii)  every  cell  of  A^  must  be  covered  by  at  most  one 
line  In  C,  If 

(16)  At  n Ij  PI  Jj  * 0, 

then  again  no  positive  penalty  can  be  applied  to  the  arc  set  (St,St). 

Now  assume  neither  (15)  nor  (16)  holds.  Then  if  (I^.J^,)  covers  A^,  we  set 
C = 1^  U and  we  are  done;  otherwise  we  use  the  Hungarian  algorithm  to 
complete  the  search  for  a cover  satisfying  (i),  (ii) , (iii) . If  such  a 
cover  exists,  the  Hungarian  algorithm  finds  it,  and  given  by  (13)  can  be 
applied  as  a penalty;  otherwise  the  Hungarian  method  finds  a cover  which  violates 
some  of  the  conditions  (i) , (ii) , (iii),  in  which  case  no  positive  penalty  can 
be  applied. 

If  T2  is  the  index  set  of  the  inequalities  (7b)  which  admit  positive 
penalties  we  have  the  following 

Proposition  7 . 


(17) 


tcT 


is  a lower  bound  on  the  value  of  the  current  subproblem. 


Proof . Whenever  a penalty  n > 0 is  applied  to  an  arc  set  (Sc»St) 
associated  with  a constraint  (7b),  the  cost  function  of  AP  is  modified,  and 
the  value  of  the  solution  x,  hence  also  the  value  of  a solution  to  the  dual 
of  AP,  the  assignment  problem  with  the  modified  costs,  is  increased  by 
| s t M- c • Thus,  after  applying  |t2|  penalties  the  value  of  an  optimal 
solution  (u,v)  to  the  dual  of  AP  is 


A 
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■i 


h 


Z a + 2 0 - v(AP)  + E is.  In.. 
ieN  jeN  J teT2 

Using  Proposition  1,  and  noting  that  a^  = 1 for  t e and  a^  = 1 - | s 1 1 
for  t eTj,  we  obtain  the  lower  bound 


B 


2 


Z fl  + Z ♦ + E X + Z (1-  |S  |)4 
i*N  jcN  J t*T^  teT 


= v(AP)  + Z X + Z 4. 
teTj.  t*T2 

= B + Z 4t-|| 
teT2 

2 -3.  Bounding  Procedure  3 searches  for  inequalities  of  the  form  (7c)  which 
are  violated  by  x and  admit  a positive  multiplier  \>t  without  requiring 
changes  in  the  multipliers  assigned  earlier.  This  is  done  by  checking  for 
each  node  whether  it  is  an  articulation  point  of  G^.  If  node  k is  an  articula- 
tion point,  i.e.,  if  the  subgraph  <^N  - (k£>  of  GQ  is  disconnected,  with  St 
as  one  of  its  components,  then  denoting  K[  = (St,?t\[k})  and  K^.'  = (St\{k),S  ) 
we  have 

K't  n A0  = 0,  K"  n A0  = 0. 

Thus  we  can  apply  a positive  premium  to  the  arcs  in  the  pair  of 
cutsets  K^,  K",  whose  value  is 

(18)  v = min  c . 

(i,j)cK/tUK"  lj 

If  T^  is  the  index  set  of  all  those  inequalities  (7c)  found  to  admit 
a positive  multiplier,  at  the  end  of  Bounding  Procedure  3 we  have  (from 


1 
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Proposition  1 and  (17))  the  lower  bound 


B3  * B2  + E vc 


v(AP)  + Z \t  + Z nt  + Z vt. 


'■eij 

If  at  any  time  during  the  Bounding  Procedure  the  current  lower  bound 
matches  (or  exceeds)  the  upper  bound  given  by  the  value  of  the  best 
available  tour,  the  current  subproblem  is  fathomed  and  we  turn  to 
another  node  of  the  search  tree.  Otherwise,  after  obtaining  the  bound 
we  try  to  find  a tour  in  Gq. 

2.4.  Example  1.  Consider  the  9-city  TSP  whose  cost  matrix  is  shown  in  Table  1 
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Table  1 


The  solution  to  AP  has  value  31.  The  reduced  cost  matrix  [ c ^ ^ ) is 
shown  in  Table  2 and  the  solution  x is  given  by  x^  * 1 for  those  (i,j) 
corresponding  to  boxes  in  that  matrix,  * 0 otherwise.  The  corresponding 
admissible  graph  is  shown  in  Fig.  1. 
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LC  , . J=  5 
i-3 


.1  13  ; Oj  X 13  9 12  10 

4 9 6 11  X 0 . 4 5 


l£J  5 


Table  2 ■ 


Bounding  procedure  1.  Cutset  K1  * ( {1,2,3},  (4, 5, 6, 7 ,8,9}  admits  X.^  = 
and  cutset  Kj  * ( {4,5},  (1,2,3, 6, 7, 8, 9}  ) admits  = 3.  The  lower  bound, 
from  (12),  becomes  = 31  + 4 + 3 * 38.  The  new  reduced  cost  matrix  is  shown 
in  Table  3 and  the  corresponding  admissible  graph  in  Fig.  2. 
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Bounding  procedure  2.  The  subtours  of  the  AP  solution  are  (1,2,3),  (4,5)  and 
(6, 7, 8, 9).  Subtours  (1,2,3)  and  (6, 7, 8, 9)  do  not  admit  positive  values  of 
However,  inequality  (7b)  for  subtour  (4,5)  is 

(x45  + x54^  — “1* 

and  a set  C of  lines  of  the  matrix  of  Table  3 satisfying  the  conditions  of 
Proposition  6 for  this  subtour  is  given  by:  (row  5,  column  5).  From  this 
set  C we  compute  = 2.  From  Proposition  7,  the  lower  bound  becomes 


B2  » 38  + 2 = 40. 


The  new  reduced  cost  matrix  [c^]  is  shown  in  Table  4,  and  the  corresponding 


admissible  graph  in  Fig.  3. 


c.  . J = 

JO 


Tab  It 


Bounding  procedure  3.  Vertex  8 is  an  articulation  point  of  the  admissible 
graph  of  Fig.  3.  The  cutsets  corresponding  to  this  articulation  point  are 
K'  - ({1,2,3},  {4, 5, 6, 7, 9})  and  = ( {4, 5 ,6 ,7 , 9} , {l,2,3}).  Applying  (18)  to 
Table  4,  we  obtain  vt=2,  corresponding  to  element  (5,1).  From  (19)  the  lower 
bound  becomes  B^=  40+2  = 42.  The  new  reduced  cost  matrix  and  the  corresponding 
admissible  graph  are  shown  in  Table  5 and  Fig.  4 respectively. 
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1 2 3 -j  « 7 3 


Establishing  whether  a graph  contains  a tour  (i.e.,  is  hamiltonian) 
is,  from  the  point  of  view  of  worst-case  analysis,  of  the  same  order  of 
difficulty  as  finding  an  optimal  tour.  However,  for  the  vast  majority  of 
all  possible  graphs,  the  first  problem  is  incomparably  easier  than  the  second 
one.  We  use  a specialized  implicit  enumeration  procedure,  the  multi-path 
method  of  [4],  ch.  10,  for  finding  a tour  in  Gg  if  one  can  be  found  without 
exceeding  a given  time  limit.  Let  x denote  the  solution  associated  with  such 
a tour.  If  x satisfies  with  equality  all  inequalities  associated  with  positive 
multipliers  (i.e.,  if  the  tour  defined  by  x crosses  exactly  once  each  cutset  Kt>  teT^, 
contains  exactly  | S J - 1 arcs  with  both  ends  in  St  for  all  sets  St,  ttTj, 
and  contains  exactly  one  arc  of  each  pair  of  cutsets,  Kt',  k",  t e Tg) , then 
x defines  an  optimal  tour  for  the  current  subproblem,  and  the  latter  is  fathomed. 

For  example,  after  bounding  procedure  3,  when  Gg  is  the  graph  of  Fig.  4, 
the  following  tour  is  detected  in  G^:  H=(1,2,3,8>9>6,7,4,5,1) . This  tour 

satisfies  with  equality  all  four  constraints  with  positive  associated 
Lagrange  multipliers;  i.e.,  H contains  exactly  one  arc  of  each  of  the  cutsets 
^ and  Kg,  contains  exactly  one  arc  of  the  subtour  {(5,4),  (4,5)},  and 
contains  exactly  one  arc  of  the  set  U . Thus,  H is  an  optimal  solution 
to  the  TSP  and  B^=  42  is  its  value. 
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If  an  inequality  that  is  slack  for  x belongs  to  one  of  the  sets  (7a) 
or  (7b),  we  attempt  to  strengthen  the  current  lower  bound  by  introducing 
some  new  inequalities  (of  the  same  type)  that  are  tight  for  x,  and  that 
admit  positive  multipliers.  If  the  attempt  is  successful,  it  may  also 
result  in  the  removal  of  the  inequality  that  is  slack  for  x. 

3.1.  Bounding  Procedure  4.  Suppose  the  inequality  (7a)  associated  with 
the  cutset  Kt  is  slack  for  x,  i.e.,  the  tour  H defined  by  x intersects  Kt 
in  more  than  one  arc,  and  let  Hf7Kt  = £ ( i ^ , j ^) , . . . , (ip,  j ) } . For  every 
( i r , j ^)  e HfKt,  let  S be  a set  of  nodes  containing  and  such  that,  denoting 

Sr  = N\Sr,  the  cutset  Ktr=  (l>r,Sr)  contains  no  other  arc  of  H than  (i  ,j  ). 
Then  the  inequalities 

r x > 1,  r - 1 

(i> j )«Ktr  J 

are  all  satisfied  with  equality  by  x.  Since  every  ^contains  an  arc  with 
zero  reduced  cost,  namely  the  arc  (ir>Jr)  also  contained  in  Kt>  the  above 
inequalities  do  not  admit  a positive  premium,  unless  the  premium  \ 
applied  to  is  reduced.  If  this  is  done,  however,  then  a positive 
premium  may  be  applicable  to  several  of  the  sets  K^.and  the  sum  of  these 
premia  may  well  exceed  the  amount  by  which  \ must  be  reduced,  i.e.,  an 
improvement  of  the  lower  bound  may  be  obtained.  The  conditions  under  which 
this  is  possible  are  stated  in  the  next  two  propositions. 

Proposition  8.  The  tour  H intersects  the  cutset  Kfcr=  (§r,Sr)  only  in 
the  arc  (ir>jr),  if  and  only  if  the  arcs  of  H with  both  ends  in  Sr  form  a 
path  whose  first  node  is  j ^ . 
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Proof.  Let  H = (i(l) , . . . ,l(n) },  and  without  loss  of  generality, 
assume  (i^.j^)  = {i(l),i(2)}.  Now  suppose  either  Sr  = (j(2)},  or  the 
arcs  of  H with  both  ends  in  S form  a path  [i  (2 ),..., i (k) } . Then  H 
intersects  the  cutset  K = (S^S17)  in  the  single  arc  [i(l),i(2)]  = (i^.j^). 

Conversely,  suppose  S f-  ij(2)J  and  the  arcs  of  H with  both  ends  in  S 
either  form  a path  P whose  first  node  is  not  j(2),  or  do  not  form  a path.  In 
the  first  case,  HfK^  = [ i (h)  , i (h+1) ] , where  i(h+l)  is  the  first  node  of  P. 

A J* 

In  the  second,  the  arcs  of  H with  both  ends  in  S form  k paths  P^,...,P^, 
with  k > 2;  and  HCK^  = [i(h^) ,i(hj+l)l , . . . , [i(h^) ,i(hk+l)] , where  iCh^+l) 

is  the  first  node  of  P , r = 1 k. || 

Proposition  9.  A positive  premium  can  be  applied  to  the  cutset  K 
(provided  that  A is  decreased)  if  and  only  if 

(20)  (KtrXKt)  n A0  = 

If  R M is  the  set  of  those  rj{l p]  for  which  (20)  holds,  the 

maximum  premium  applicable  to  each  K^,  r eR,  is 

(21)  Xr  * min  (X  , min  c } > 0; 

provided  the  premium  Xt  applied  to  Kt  is  replaced  by 

(22)  Xfc  = X - max  Xr. 

rcR 

This  replaces  the  current  lower  bound  B by 

(23)  B'  - B + Z Ar  - max  Xr. 

rcR  r«R 

Proof.  A decrease  in  X£  increases  the  reduced  costs  of  all  arcs 
of  ; hence  makes  it  possible  to  apply  a positive  premium  to  the  arcs 





of  those,  and  only  those,  cutsets  satisfying  condition  (20)  The 
maximum  size  of  the  premium  on  I^r  is  \V  defined  by  (21),  positive  for 
those  r for  which  (20)  holds.  The  premia  X are  however  applicable  only 
if  X is  diminished  by  the  amount  of  the  largest  premium  applied  to  the 
arcs  of  any  cutset  K^.  i.e.,  only  if  X is  replaced  by  Xfc  of  (22) 
(otherwise  some  of  the  reduced  costs  become  negative).  If  this  is  done, 
the  current  lower  bound  B is  replaced  by 

b'  = B + Z Xr  + (X  - X ) 
reR  C C 

A 

which  yields  (23)  after  substituting  for  X c - ! | 

Bounding  Procedure  4 looks  for  cutsets  to  which  a premium  Xfc  > 0 

had  been  applied  and  which  are  intersected  by  the  tour  H in  more  than  one 

arc.  For  each  arc  ( i , j ) of  H that  belongs  to  such  a cutset  , we  try 
r 

to  find  a set  S of  nodes  containing  j and  satisfying  the  conditions 

A 

of  Propositions  8 and  9;  i.e.,  such  that  the  arcs  of  H with  both  ends  in  S 

-r  £ 

form  a path  whose  first  node  is  j , and  that  the  cutset  (S  ,S  ) 

satisfyies  (20).  As  a matter  of  practicality , we  first  try  |sr|  = 2,  then 
| Sr | = 3 etc.,  until  either  we  find  a set  which  satisfies  (20)  or  we  find 

out  that  none  exists.  Taking  the  candidate  sets  in  this  order  makes  sense 
£ 

since  smaller  sets  S define  smaller  cutsets  K^.  over  which  one  takes  the 

minimum  in  (22)  to  define  the  premia  Xr. 

£ 

If  no  sets  S with  the  desired  properties  is  found,  we  take  another 
arc  of  HflKj..  Otherwise  we  compute  X , the  premium  to  be  applied  to  the 
cutset  Ktr,  using  (22);  and  then  take  the  next  arc  of  H f)  K . When  all  arcs 
of  HflK^have  been  examined,  we  compute  the  new  value  \ of  the  premium 
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applicable  to  the  arcs  of  Kt>  as  given  in  (22),  and  replace  Xc  by  All 


this  replaces  the  reduced  costs  c . . by 


_ * 

c 


■ 


c.  . - X 
ij 


ij 


r s 

\ + max  X 


c . . + max  X 
seR 


'ij 


scR 

s 


(i>  j)  e Ktr\Kt,  r e R 
(i,j)  eKtrnK(;,  r e R 


(i,j)  e K \ ( U Kts) 
seR 

all  other  (i , j)  e A 


and  the  lower  bound  B by  B/  defined  in  (23).  If  X > 0,  the  inequality 
associated  with  Kt  (which  is  slack  for  x)  continues  to  be  represented  in 

A j* 

the  Lagrangean  form  (l7).  If,  however,  X = 0,  i.e.,  max  X = X , then 

reR 

the  inequality  corresponding  to  Kt  is  removed  from  (l')  and  we  have 
succeeded  in  replacing  this  constraint,  slack  for  the  solution  x,  with  a 
set  of  inequalities  that  are  all  tight  for  x. 

If  is  the  index  set  of  those  inequalities  (7a)  that  are  slack  for 
x and  for  which  |r|  ^ 0,  and  if  we  attach  a subscript  t to  the  index  sets 
R associated  with  each  cutset  Kt  and  to  the  premia  \T  indexed  by  R,  then 
at  the  end  of  Bounding  Procedure  4 we  have  the  lower  bound 


(24) 


B-  + E £ X - £ max  X . 

teTt  r«R.  teT?  reRfc 

it  it 


3.2.  Example  2 . Consider  the  reduced  cost  matrix  of  Table  6 resulting  from 
the  solution  of  AP  for  an  8-city  TSP.  The  value  of  the  AP  solution  is  v(AP) 

= 50.  The  admissible  graph  is  given  in  Fig.  5. 
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Applying  bounding  procedure  1 

and 

taking  cutset  K 

L=  ([1,2, 3, 4)  [5, 6, 7, 8}) 

we  obtain  3 and  hence 

Br 

53. 

The  reduced  cost  matrix  [ c ^ ] is  shown 

in  Table  7 and  the  admissible 

graph  G( 

3 ia  Fig.  6. 
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Bounding  procedure  1 is  complete  and  bounding  procedures  2 and  3 are 
unsuccessful  in  improving  the  bound  beyond  B = 53. 
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A tour  H = (1,5, 6, 2, 3,7, 8, 4,1)  is  detected  in  GQ,  but  H contains 

two  arcs  of  the  cutset  K^,  and  is  therefore  not  necessarily  optimal. 

Applying  bounding  procedure  4 to  K , we  identify  the  cutsets  K 

1 1,1 

({1,2, 3, 4, 5, 6},  {7,8})  with  \ £ = 2,  and  ?=  ([1,2, 3, 4, 7, 8],  {5,6})  with 
2 

X^=  2,  while  reducing  the  multiplier  associated  with  cutset  from 
X1»  3 to  X1»  1. 

The  new  reduced  cost  matrix  is  given  in  Table  8 and  the  associated 
admissible  graph  is  shown  in  Fig  7. 


The  lower  bound  is  now  improved  from  53  to  = 53  + 2 + 2 - 2 =55, 
as  given  by  (24). 

Next  we  turn  to  the  inequalities  (7b). 

3.3.  Bounding  Procedure  5.  Suppose  the  inequality  (7b)  defined  by  the 
node  set  is  slack  for  x,  i.e.,  the  tour  fl  contains  fewer  than  | S ^ ( - 1 

arcs  of  the  set  (S  ,S  ).  Let  be  the  subgraph  of  G induced  by  the  arc 

A A 

set  H 0 (St>St),  i.e.,  the  graph  consisting  of  those  arcs  of  the  tour  H 
with  both  ends  in  S^,  and  the  end-nodes  of  these  arcs.  Note  that 

A 

H fl  (St,Sc)  may  be  empty,  since  it  is  possible  for  a tour  to  contain  all 
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nodes  in  St  without  containing  any  arc  with  both  ends  in  S ^ ; and  when  this 
is  the  case,  no  new  inequalities  can  be  derived  from  St. 

A IS 

Assume  now  that  H 0 ( S c ^ ^ ^ 0,  and  let  C , . . . ,C  be  the  (connected) 
components  of  Gt-  For  qeQ  = let  Sq  and  Aq  denote  the  node  set 

q q 

and  arc  set,  respectively,  of  C . By  construction,  each  C is  an  open 
(directed)  path,  with  2 < [sq|  < f S [ - 1 and  | Aq ( = |sq|  - 1;  hence  x 
satisfies  with  equality  each  of  the  inequalities 

c q 2 q Xi.  < | sql  - 1 , q * Q 

i e Sq  j e Sq 

or,  to  put  them  in  the  form  (7b), 

(25)  - 2 S x.,  > 1 - jSq|  , qeQ  . 

i e Sq  j e Sq  1J 

Since  (Sq,Sq)HA0  ^ 0 ,V  q c Q , these  inequalities  do  not  admit  a positive 
penalty  (without  a change  in  the  dual  variables  u,v)  , unless  the 
penalty  associated  with  is  reduced.  If,  however,  this  can  be  done, 
then  each  of  the  inequalities  (25)  admits  a positive  penalty  and  the  current 
lower  bound  may  be  strengthened.  The  next  proposition  states  the  conditions 
for  this. 

Let  be  the  set  of  those  arcs  of  G having  both  ends  in  St>  but  not 
both  ends  in  the  same  set  Sq  , for  any  qeQ;  i.e.,  let 

F - (S  ,S  ) - U (Sq,Sq)  . 
q c Q 

Proposition  10.  A penalty  y*  > 0 can  be  applied  to  each  of  the  arc 
sets  (Sq,Sq),  qeQ  (provided  that  the  penalty  is  decreased),  if  and  only 
if 

F n Ao  = 0 . 


(26) 
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(27) 


If  (26)  holds,  then 
* 


min  c > 0 
(i  > j)  «Ft 


and  the  penalty  p*  can  be  applied  to  each  arc  set  (Sq,Sq)  provided  that  the 

it 

penalty  pt  applied  to  (sc>St)  is  replaced  by  p - pt  . This  replaces  the 
current  bound  B by 


(28) 


b"=  B + ( | Q(  - 1)p£  . 


Proof.  Since  (Sq,Sq)  C (St,St)  and  (Sq,Sq)  D Aq  t 0 , Vq  eQ  , a positive 
penalty  p*  can  be  applied  to  any  (and  all)  of  the  arc  sets  (Sq,Sq)  if  and 
only  if  the  penalty  pt  applied  to  the  arc  set  (Sc,Sc)  can  be  reduced  by  the 

'fc 

same  amount  pt  . This,  however,  is  possible  if  and  only  if  no  arc  in  the 
set  has  a zero  reduced  cost  (i.e.,  condition  (26)  is  satisfied) 

k 

and  does  not  exceed  the  reduced  cost  of  any  arc  in  F . When 

these  conditions  are  present,  all  arc  sets  (Sq,Sq),  q e Q , can  be  penalized 

by  the  amount  p^  specified  in  (27)  , provided  the  penalty  p^  on  the  arc  set 

k 

(St,St)  is  replaced  by  p£  - pc  . The  effect  of  all  this  on  the  lower  bound 
is  to  add  p*  as  many  times  as  the  number  |q|  of  components  of  Gt>  and  to 
subtract  p*  once;  i.e.,  to  add  to  the  current  bound  B the  amount 

(|Q|  - n**  • !! 

Bounding  Procedure  5 takes  an  inequality  (7b)  that  is  slack  for  x,  forms 
the  associated  arc  set  F defined  above,  and  checks  condition  (26).  If  (26) 
is  not  satisfied,  nothing  can  be  done,  and  the  procedure  goes  to  the  next 
inequality  that  is  slack  for  If  (26)  holds,  we  calculate  p*  given  by  (27), 
and  penalize  by  p*  all  arc  sets  (Sq,sq),q«Q,  defined  by  the  components  of 
the  graph  Gt;  while  replacing  the  penalty  p£  on  the  arcs  of  (Sc,St),  by 
Pt  - p*  . This  replaces  the  reduced  costs  c^j  by 
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- / 

c 

ij 


ij 


CU  * 


(t,j)  e F 


(t,j)  * A\Ft  , 


and  the  current  lower  bound  B by  b”  defined  by  (28).  If  tfle 

inequality  (7b)  defined  by  the  vertex  set  St  (which  is  slack  for  x) 
continues  to  be  part  of  the  Lagrangean  expression  (l');  if,  however, 

U*  * l±t , i.e.  the  penalty  associated  with  the  inequality  in  question 
becomes  zero,  then  we  have  succeeded  in  replacing  this  inequality  in  (1 ') 
by  a set  of  other  constraints  that  are  all  tight  for  x . 

Next  the  procedure  goes  to  another  inequality  (7b)  that  is  slack  for 

A + 

x.  When  all  such  inequalities  have  been  examined,  let  T9  be  the  index  set  of 
of  those  among  them  for  which  condition  (26)  was  satisfied,  and  for  each 
t e T* , let  | Q 1 1 be  the  number  of  components  of  the  graph  G^.  Bounding 
Procedure  5 then  produces  the  lower  bound 

«»>  8 - 8 + I +<|Qt|-t>»*  • 

C,T2 

Finally,  we  turn  to  the  inequalities  (7c). 

3.4  Bounding  Procedure  6.  Suppose  the  inequality  (7c)  associated 
with  the  articulation  point  k and  the  cutsets  K*  * (St>  \ [k}), 

K"»  (S  \{k},S  ) is  slack  for  x,  i.e.,  the  tour  H defined  by  x contains  more  than 
one  arc  of  the  set  U , and  let  H (K^UK^.  ) ” i (1^  » J ^)  » • • • » (ip  > Jp^  } • ^or 
every  (i  , J ) «H  fl  (K*  UK"  ) , r-  l,...,p,  we  will  specify  a node  set 
SrCN\(k]  such  that,  denoting  ^ * N\Sr  and  = (Sr,¥r\{k)),  « (S  \[k}),S  ), 

the  only  arc  of  H contained  in  K^rUKtr  *-s  ^r’^r^' 


I 
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Proposition  11.  The  only  arc  of  H contained  in  K'  Uk"  is  (i  . i 1 . 

tr  tr  v r’Jr  ’ 

if  and  only  if  Sr  = S\[k],  where  S is  the  node  set  of  one  of  the  two  paths 

= (k ir}  and  ?2  = (j^ k}  in  H. 

Proof.  Assume  Sr  = S\(k},  where  S is  the  node  set  of  P1  or  P? . In 

the  first  case,  HflK^  = £ (if , j r)  } and  HflK^  = 0;  in  the  second,  H fl  = 0 

and  H fl  = {(i^.j^)}.  In  both  cases,  ( i r , j f ) is  the  only  arc  of  H contained 


in  K'  UK"  . 
tr  tr 


Conversely,  let  (ir>jr)  be  the  only  arc  of  H contained  in  UK"r. 


Then  either  £dr,  } = HHK^  and  H H K "r  = 0,  or  £(ir>  Jr)  } = HflK^  and 

A / A j* 

H fl  K =0.  In  the  first  case,  H enters  S from  k rather  than  from  some 
of  Sr\(k},  since  H fl  K " = 0;  and  it  exits  Sr  exactly  once,  through  i^; 


hence  Sr  = S\(k},  where  S is  the  node  set  of  P^.  In  the  second  case,  H 
exits  Sr  through  an  arc  whose  front  end  is  k,  rather  than  some  node  of 
Sr\{k},  since  HOk^  = 0;  and  it  enters  Sr  exactly  once,  through  j ; 
hence  Sr  = S\{k},  where  S is  the  node  set  of  P?.|| 

Thus,  if  the  node  sets  S , r = l,...,p,  satisfy  the  conditions  of 
Proposition  11,  then  the  inequalities 


<i,J)«KtrUKtr 


— x > 1 
" ij  - 


r = 1, , 


are  all  satisfied  by  x with  equality.  The  next  proposition  states  the 
conditions  under  which  a positive  premium  can  be  applied  to  the  sets  K^r^^tr" 
Proposition  12.  A positive  premium  can  be  applied  to  the  arc  set 
U K "r  if  and  only  if 


(30) 


!(^ruK''r,\Ktin*0-  t. 
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; 

; 

i 


■' 


V 


If  R M is  the  set  of  those  r«{l p}  ,for  which  (30)  holds,  the 

maximum  premium  applicable  to  each  K^LIK^,  reR,  is 

(31)  vr  = min(v  min  c }, 

(i, j)eK  1J 

where  K = provided  the  premium  applied  to  is 

replaced  by 

(32)  v » v - max  v1. 

rcR 

This  replaces  the  current  lower  bound  B by 

(33)  B ' =*  B + Z vr  - max  vT . 

reR  reR 

Proof . Analogous  to  the  proof  of  Proposition  9.,j 
Bounding  Procedure  6 looks  for  indices  teT^  for  which  a positive 
premium  has  been  applied  to  the  arc  set  K^UK^  , and  for  which 

H 0 (K^  U K " ) = {.(i-i , J ^) (ip,  Jp)  },  with  p > 2.  Given  such  a ttTj, 

for  each  re[l p}  we  use  the  node  set  of  the  path  P^  = (k,...,t  ) in  H, 

after  removing  from  it  node  k,  to  derive  an  arc  set  of  the  form  Kfc'  U 
defined  in  Proposition  11.  We  then  check  whether  U Kj*  satisfies  (30), 
and  if  so,  we  calculate  the  premium  vf  to  be  applied  to  K^UK^;  otherwise 
we  move  to  the  next  r«{l,...,p}.  When  all  arcs  of  H 0 (K^  L K ) have  been 
examined,  we  compute  the  value  v of  the  premium  applicable  to  the  arcs 
of  Kt,  as  given  by  (32),  and  replace  by  vc.  All  this  replaces  the 
reduced  costs  c^  by 
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ij 


Cij  ‘ V 

- r s 

c - v + max  v 

1 J seR 


c . + max  v 
1J  seR 


(i,j)e(Kt'rUK"r)\Kt,  reR 
(i.j)e(K'rUK"r)  0Kt,  reR 

(i,j)eKt\  U <K'SUK"B) 
seR 

all  other  (i,j)eA 


and  the  lower  bound  B by  B ' defined  in  (33). 

As  in  the  case  of  Procedures  4 and  5,  if  v * 0,  the  inequality 
associated  with  K^UK^is  removed  from  the  Lagrangean  function  (1/), 
otherwise  it  stays  there  with  the  new  premium. 

Let  be  the  index  set  of  those  inequalities  (7c)  that  are  slack  for 
x and  for  which  |r|  ^ 0,  and  let  us  attach  a subscript  t to  the  index 
set  R associated  with  U and  to  the  premia  vr  indexed  by  R.  At  the 
end  of  Bounding  Procedure  6 we  then  have  the  lower  bound 

(34)  B,  = B,  + E E - E max  vr. 

teT^  reRt  t«T*  rcRt 


Naturally,  if  at  any  stage  of  the  bounding  procedures  described  above 
the  lower  bound  for  the  current  subproblem  matches  the  upper  bound  on  v(TSP) 
given  by  the  value  of  the  best  tour  at  hand,  the  current  subproblem  is  fathomed 
At  this  point  we  may  find  ourselves  in  one  of  two  possible  situations: 

(®)  we  have  found  a tour  in  Go,  and  used  it  to  obtain  the  lower  bound  B^ 
on  the  value  of  the  current  subproblem;  or  (0)  the  attempt  to  find  a tour  was 
unsuccessful,  and  is  the  best  lower  bound  we  have  for  the  current 

subproblem.  In  case  (8),  we  define  Gg  » (N,Ag),  with  » {(i,J)cA|c1j  < e}, 

where  the  c^  are  the  current  reduced  costs  and  c is  the  smallest  number 
for  which  we  are  able  to  find  a tour  in  Gg  within  the  given  time  limit.  In 
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either  case,  we  denote  by  H the  tour  at  hand,  by  x the  associated 
solution,  by  c „ , (i,j)eA,  the  last  set  of  reduced  costs,  and  by  B the 
lower  bound  for  the  current  subproblem.  Obviously  cx,  where  c is  the  original 
cost  vector,  is  an  upper  bound  on  v(TSP) , and  the  best  such  upper  bound  at 
each  stage  will  be  denoted  by  B*. 

3.5.  Computational  complexity  of  the  bounding  procedures.  Each  of  the  six 

bounding  procedures  discussed  in  sections  2 and  3 is  polynomially  bounded. 

For  each  of  them  except  for  the  first  one,  the  number  of  operations  required 

3 

in  the  worst  case  is  0(n  ),  where  n is  the  number  of  cities.  For  procedure  1, 

4 

this  number  if  0(n  ).  Solving  the  assignment  problem  at  the  start  also 

3 

requires  at  most  0(n  ) operations. 

At  every  node  of  the  search  tree,  the  bounding  procedures  are  applied 
once  (after  solving  the  assignment  problem,  if  necessary)  in  the  order  1,2,3. 

Tf  at  that  point  the  node  was  still  not  fathomed  (i.e.,  the  lower  bound  is 
still  below  the  current  upper  bound),  an  attempt  is  made  at  finding  a tour  in  G^. 
Though  there  is  no  algorithm  guaranteed  to  accomplish  this  in  polynomial  time, 
we  let  our  implicit  enumeration  procedure  run  only  for  a fixed  amount  of  time, 
that  is  an  input  parameter  defined  as  a linear  function  of  n.  If  a tour  is 
found,  bounding  procedures  4,5,6  are  applied  in  that  order;  otherwise  we 
branch . 

In  conclusion,  the  amount  of  work  performed  at  any  given  node  of  the 
4 

search  tree  is  0(n  ) in  the  worst  case. 

4.  Branching  Rules 

Before  branching,  we  attempt  to  fix  some  variables  by  using  the 
bounds  B and  B*.  Let 


Q0  - C ( i , J ) cA 1 c t j > B*  - B}. 
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It  is  not  hard  to  show  (see  [1])  that,  if  the  reduced  costs  c_  are  derived 
from  the  same  dual  solution  and  Lagrange  multipliers  as  the  lower  bound  B (as 
is  the  case  here),  then  any  solution  x to  TSP  such  that  cx  < B* 
must  satisfy  the  condition  x^  = 0,  ¥(i,j)eQQ.  Hence  we  set  x = 0,  (i,j)eQQ 
for  the  current  subproblem  and  its  descendants,  i.e.,  we  replace  A by  A\Qq. 

Next  we  describe  two  branching  rules,  which  we  use  intermittently. 

The  first  rule  derives  a disjunction  from  a conditional  bound  [1];  the 
second  rule  derives  one  from  a subtour-breaking  inequality. 

4.1.  A disjunction  from  a conditional  bound  can  be  obtained  as  follows. 
Consider  a family  of  sets  Q|CCA,  k = l,...,p,  such  that  c„  >0,  ^(i.jjeQ^, 
k = l,...,p.  Then  if  the  inequalities 


xti  > 1 » fc  = 1.....P 

(i,j)eQk  J 

were  added  to  the  constraint  set  of  LP,  the  lower  bound  B could  be  improved 

by  choosing  appropriate  multipliers  for  these  inequalities.  Further,  if 

this  improved  bound  (termed  conditional,  because  of  the  hypothetical  nature 

of  the  inequalities)  matches  the  upper  bound  B*,  then  every  solution  better 
than  the  one  associated  with  B*  violates  at  least  one  of  the  above  inequalities 

i.e.,  satisfies  the  disjunction 

P 

(35)  V (x  - 0,  ¥(i,J)cQk). 

k=  1 


To  implement  this  principle,  we  first  remove  from  the  Lagrangean 
function  (1 ')  all  those  inequalities  (7a)  and  (7c)  that  are  slack  for  x 
while  the  associated  multiplier  wt  is  positive.  If  T+  is  the  index  set  of 
these  inequalities,  this  removal  amounts  to  replacing  B by 

£ - B - E w 

--T+  C 
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and  c. . bv 

ij 


c . . = c . . + £ a w 

1J  1J  teT+  ij  C 


for  (i,j)eA. 

Next,  we  choose  a minimum-cardinality  arc  set  SCH  such  that 

(36)  Z11I  c > B*  - B. 

(i,j)eS  iJ 

The  existence  of  such  SCH  would  be  guaranteed  if  we  removed  from 
(1 ;)  all  inequalities  (7)  that  are  slack  for  x (see  [ 1]  for  a proof). 
However,  removing  the  inequalities  (7b)  would  either  produce  negative 
reduced  costs,  or  would  require  a recalculation  of  the  u^  and  v^ . To  avoid 
this  recalculation,  we  restrict  ourselves  to  the  removal  of  inequalities 
(7a)  and  (7c),  taking  the  risk  of  not  being  able  to  find  a set  SCH  satisfying 
(36).  Whenever  this  happens,  we  apply  the  second  branching  rule,  to  be 
discussed  below. 

Given  that  (36)  holds,  let  S = £ (i,  , j .),...,  (i  ,j  )}.  We  then 

i 1 P P 

construct  a p x |a|  0-1  matrix  D = (d^)by  setting  d£  = 1 in  each  column 
(i, j)  for  as  many  indices  ke£l,...,p}  as  possible,  subject  to  the  conditions 


(37) 
and 

(38) 


d =1 
i 1 
kJk 


1 9 • • • y P 


< C, 


k=l  Vk 


(t,j)6A 


These  constraints  leave  some  freedom  for  choosing  the  entries  d^  of 
each  column  (i,j)eA,  which  we  use  to  make  the  number  of  l's  in  each  row  as 
close  to  equal  as  possible. 
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Proposition  L3.  Every  solution  x to  TSP  such  that  cx  < B*  satisfies 
the  disjunction 
P. 

(39)  V (x. , = 0,  ¥(i,j)eQ.), 

k=l  1J  K 

where 

(40)  Q = ( (i , j) eA |d^  =1}  , k = l,...,p. 

K ij 

Outline  of  proof  (see  [ 1 ] for  details).  If  x violates  (39),  it  satisfies 

(41)  >_  ~ x > 1 , k = l,...,p. 

(i.j>eQk  J 

Adding  (41)  to  the  constraint  set  of  LP  and  assigning  the  multiplier  (dual 
variable)  c.  . to  the  kC^  inequality  (41),  yields  the  lower  bound 

Vk 

P A . 

B + £ c.  . = B + «; c . . 

k=l  Vk  (i,j)eS  tJ 

> B* 

where  the  last  inequality  follows  from  (36).  Hence  cx  > B*. 

The  disjunction  (39)  creates  p subproblems.  In  the  k^  subproblem 
we  have  x = 0,  (i,j)eQk,  and  since  (i^ , jfc) eH  0 Qk , the  tour  H becomes 
infeasible  for  each  of  the  subproblems.  On  the  other  hand,  the  current 
solution  to  AP  remains  feasible  for  each  of  the  subproblems. 

4.2.  A disjunction  from  a subtour  breaking  inequality  is  obtained  in  the 
usual  way;  i.e.,  if  S is  the  arc  set  of  a subtour  of  the  AP  solution,  then 
every  solution  to  TSP  satisfies  the  disjunction: 

(42)  \ / ( x = 0 and  x * 1,  V'.  < k-1) 

V Vk  W 


< 
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At  an  arbitrary  node  of  the  branch  and  bound  tree,  a subset  S'CS  of  the 
arc  set  S (of  the  subtour  selected  for  branching)  may  already  have  been 
fixed  to  be  in  the  solution.  In  this  case  set  S in  disjunction  (42)  is 
replaced  by  S\S'.  Branching  on  (42)  creates  |s\S'|  subproblems.  For 
each  of  these  subproblems,  the  AP  solution  to  the  parent  problem  becomes 
infeasible . 

In  choosing  the  arc  set  S for  the  disjunction  (42),  it  is  desirable  to 
give  preference  to  subtours  (of  the  current  AP  solution)  having  either  a 
minimum  number  of  arcs  (min  |Sj),or  a minimum  number  of  free  arcs  (min  |s\S'  () . 
In  the  computational  tests  discussed  in  the  next  section  we  used  the  first 
of  these  two  criteria. 

As  to  the  two  disjunctions  (39)  and  (42),  an  efficient  procedure  must 
use  them  intermittently,  since  (39)  can  on  occasion  be  considerably  stronger 
than  (42),  while  at  other  times  it  can  be  much  weaker.  We  tried  several 
rules  for  mixing  them,  and  the  one  actually  used  in  the  tests  is  discussed 
in  the  next  section. 

5 . Implementation  and  Computational  Experience. 

Our  algorithm  was  programmed  in  FORTRAN  IV  for  the  CDC  7600  and  tested 
on  a set  of  120  randomly  generated  asymmetric  TSP's  of  sizes  varying  between 
50  and  325  cities.  Here  we  discuss  some  features  of  the  implementation,  give 
the  computational  results,  and  interpret  them. 

5.1.  Use  of  sparsitv.  Unlike  in  the  case  of  those  symmetric  TSP's  whose 
costs  are  based  on  distances  and  can  therefore  be  generated  whenever  needed 
from  the  2n  coordinates  of  the  cities,  in  the  case  of  the  asymmetric  TSP 
one  has  to  explicitly  store  the  costs,  whose  number  in  case  of  a complete  graph 
is  n(n-l).  However,  our  procedure  derives  both  lower  and  upper  bounds  on 
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the  value  of  the  problem  and,  as  discussed  at  the  beginning  of  section  4, 
provides  a valid  criterion  for  setting  to  0 certain  variables.  As  it  will  be 
discussed  below,  the  number  of  variables  that  can  be  fixed  at  0 before  the 
first  branching  is  usually  very  high.  Therefore  at  that  point  we  actually 
remove  from  the  graph  all  those  arcs  whose  variables  can  be  fixed  at  0, 
and  from  then  on  we  work  with  a graph  (usually  quite  sparse)  represented 
by  a list  of  nodes  and  a list  of  arcs  with  their  costs.  Additional  fixing 
of  variables  (at  0 or  1)  later  in  the  procedure  is  handled  differently 
( see  below) . 

5.2.  Solution  of  the  AP's.  At  every  node  of  the  search  tree,  a subset  of 
variables  is  fixed  at  0,  another  subset  is  fixed  at  1,  and  the  current 
problem  is  the  one  in  the  free  variables.  A variable  x^.  is  set  to  1 by 
adding  a large  number  M > 0 to  all  c^,  k = 1, . . . , n,  k + j . A variable  x 
is  set  to  0 bv  adding  M to  c...  The  reason  for  not  simply  removing  the  arc 
from  the  graph,  as  done  before  the  first  branching,  is  that  (a)  the  variable 
and  its  cost  may  be  needed  later  on  another  branch;  (b)  the  transition  from 
the  old  AP  solution  to  the  one  for  the  new  subproblem  is  easier  this  way. 

All  AP's  are  solved  by  the  Hungarian  algorithm  modified  as  follows: 

(i)  At  every  subproblem,  we  start  with  a solution  derived  from  the  solution  of 
the  predecessor  problem.  In  particular,  the  growing  of  an  alternating  tree 
(in  search  of  an  augmenting  path  during  the  application  of  the  Hungarian 
algorithm)  starts  with  a matching  (i.e.,  a set  of  independent  zeroes  in  the 
reduced  cost  matrix)  derived  from  the  solution  to  the  predecessor  of  the 
current  subproblem.  A single  augmenting  path  is  almost  always  sufficient  to 
solve  the  current  AP. 
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(ii)  Since  the  Hungarian  algorithm  is  a dual  procedure,  it  can  be  terminated 
prematurely  whenever  the  value  of  the  objective  function  exceeds  the  value  of 
the  current  upper  bound. 

5.3.  Branching  and  node  selection . The  two  types  of  branching  discussed 

in  section  4 are  used  intermittently  according  to  the  following  rule.  A 

branching  of  type  1 (based  on  disjunction  (39))  is  performed  whenever  a set 

of  arcs  SCH,  S = [(i  , j ,),..., (1  ,j  )},  can  be  found,  such  that 

It  P P 

(i)  inequality  (36)  is  satisfied; 

(ii)  |s|  < ~ + 1,  where  d is  the  condinality  of  the  smallest  subtour  in 
the  current  AP  solution;  and 

(iii)  at  least  n/3  variables  can  be  fixed  at  0 on  each  branch. 

Whenever  any  of  the  above  conditions  is  violated,  a branching  of  type  2 
(using  disjunction  (42))  is  performed. 

The  node  selection  rule  used  in  the  cede  is  to  ehoose  a successor  of  the 
current  node  whenever  available,  and  otherwise  to  select  a node  k for  which 
the  following  evaluation  attains  its  minimum; 

E(k)  = f B (k)  - v(AP)  ) • 

s (0) -s (k) . 

Here  B(k)  is  the  lower  bound  for  subproblem  k,  v(AP)  is  the  value  of  the 
(initial)  AP,  while  s(0)  and  s(k)  are  the  number  of  subtours  in  the  solutions 
to  the  initial  AP  and  the  current  one  (at  node  k) , respectively.  The  integer 
s(k)  is  used  as  a measure  of  the  "distance"  of  the  AP  solution  at  node  k from 
an  optimal  tour. 

5.4.  Information  stored  for  each  subproblem.  All  subproblems  are  stored  on  a 
linked  list  in  order  of  increasing  lower  bounds.  For  each  subproblem  k the 
following  information  is  stored: 
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- The  AP  solution. 

- The  value  of  the  associated  bound. 

- A pointer  to  the  father  node  of  node  k. 

- A code  to  indicate  the  type  of  branching  (one  of  the  2 types  described 
above)  that  produced  node  k. 

- The  number  of  sons  of  the  father  of  node  k. 

- The  rank  (index)  of  node  k among  its  brothers. 


- If  the  type  of  branching  that  produced  node  k was  based  on  disjunction 
(39),  we  store  the  arcs  in  S = £(i^,j^) . . . . , (i,j) J.  If  it  was  based  on 
disjunction  (42),  then  a pointer  gives  the  subtour  in  the  AP  solution 
corresponding  to  S in  (42). 

- A list  of  the  operations  (in  coded  and  ordered  form)  which  produced 


the  current  matrix  [ c ^ ^ ] from  the  matrix  for  the  predecessor  node. 
(This  is  not  strictly  necessary  but  speeds  up  considerably  the 


backtracking  process) . 


5.5.  Computational  results.  The  above  described  code  was  run  on  the 
CDC  7600  to  solve  120  randomly  generated  test  problems  whose  associated 
(directed)  graphs  are  complete  and  whose  cost  coefficients  were  drawn  from 
a uniform  distribution  of  the  integers  in  the  range  [1,  10001 . The  problems 
belong  to  12  classes  based  on  size,  with  n = 50,  75,...,  300,  325,  and  with 
10  problems  in  each  class.  Table  9 summarizes  the  results.  These  results 
are  quite  remarkable,  in  that  the  number  of  nodes  generated  is  surprisingly 
small,  and  seems  to  increase  only  slightly  faster  than  the  problem  size 
(number  of  cities).  This  is  also  illustrated  on  Fig.  8,  where  the  slope 
of  the  curve  is  only  slightly  steeper  for  200  < n < 325  than  for  50  £ n < 200. 
Note,  also,  that  the  maximum  time  required  to  solve  any  one  of  the  120 
problems  was  82  seconds. 


Table  9.  Computational  results  on  random  asymmetri 


Other:  branching,  node  selection,  updating,  etc. 
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Since  the  average  cost  of  the  various  bounding  procedures  is  not 
proportional  to  their  usefulness,  we  have  tested  each  of  the  bounding 
procedures  individually  and  in  subsets  to  see  whether  their  use  pays  off. 

The  outcome  of  our  tests  was  that  using  all  6 bounding  procedures  is  more 
efficient  than  using  any  subset  in  any  combination. 

Another  remarkable  feature  of  the  approach  discussed  here  is  the  large 
number  of  arcs  that  can  be  removed  from  the  graph  (of  variables  that  can  be 
permanently  fixed  at  0)  at  the  root  node  of  the  search  tree,  as  a result  of 
the  test  discussed  at  the  beginning  of  section  4.  This  is  shown  in  Table  10. 
The  fact  that  such  a high  proportion  of  the  arcs  can  be  removed  before 
branching  shows  the  power  of  the  bounding  procedures  used  in  our  approach. 

For  a comparison,  if  only  the  bound  obtained  from  AP  were  used,  then  the 
percentage  of  variables  removed  in  problem  classes  1,  2 and  3 would  be  on  the 
average  87%  (and  this  percentage  does  not  seem  to  increase  with  problem  size). 
Thus,  for  problem  class  3,  for  example,  our  bounding  procedures  reduce  the 
number  of  arcs  remaining  in  the  graph  from  the  13%  that  would  be  left  by  the 
AP  bound,  to  2.9%. 

Table  10.  Percent  of  arcs  removed  on  the  average  at  the  root  node. 


Problem  class 

— 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

191 

Arcs  removed  (average)  . 

95.3 

96.4 

97.1 

97.3 

97.5 

97.6 

97.9 

98.1 

98.4 

98.3 

98.6 

— 

98.7  j 

_ "1'"  X 1UU 

Total  arcs 

In  connection  with  the  two  branching  rules,  it  is  important  to  mix  them 
judiciously.  While  rule  1 (disjunction  (39))  often  allows  one  to  fix  more 
variables  than  rule  2 (disjunction  (42)),  if  used  as  the  only  branching  rule 
it  yields  inferior  results,  since  occasionally  it  is  very  bad.  The  mixing 
strategy  used  in  the  above  runs  (and  discussed  under  5.3)  has  resulted  in 
rule  1 being  used  only  at  the  upper  levels  of  the  search  tree  (often  at  level 
1,  or  1 and  2,  only).  To  compare  the  results  obtained  by  using  this  strategy 
with  those  obtainable  by  using  rule  2 only,  we  ran  4 of  the  12  problem  sets 
(i.e.,  40  of  the  120  problems)  with  branching  rule  2 only.  Table  11  compares 


the  results. 
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Table  11.  Comparison  of  branching  rules 


Class 

n i 

i 

Average 

no.  of  nodes 

Computing  time  CCDC  7600  sec.) 

[Rule  2 

Mix  of 

rules  1 and  2 

j Rule  2 

Mix  of 

rules  1 and  2 

i 

50 

10.3 

12.3 

.29 

] 

. 20 

3 

100 

31.9 

39.  1 

2.10 

.71 

5 

150 

36.8 

45.7 

4.60 

1.97 

7 

200 

49.9 

63.4 

j 11.68 

6.06 

Mote  that  although  branching  rule  2 tends  to  produce  a smaller  number 
of  nodes  than  the  mixed  strategy  described  in  section  5.3,  it  also  tends  to 
require  about  twice  as  much  time  than  the  latter.  This  is  because  the 
disjunction  (39)  (rule  1)  creates  nodes  for  which  the  AP  solution  at  the 
father  node  remains  feasible,  and  for  which  a large  number  of  variables  can 
be  fixed  at  0 --  two  features  that  make  such  nodes  easy  to  fathom. 


6.  The  Symmetric  Case 

Our  algorithm  can  of  course  be  applied  to  symmetric  TSP' s as  it  is,  but 
it  would  not  be  efficient  for  such  problems  in  its  present  form.  This  is 
so  because  of  the  well  known  fact  that  AP' s associated  with  symmetric  TSP's 
tend  to  have  optimal  solutions  involving  a large  number  of  aubtours  of  length 
two.  However,  our  approach  can  easily  be  adapted  to  the  symmetric  case  by 
replacing  the  assignment  problem  with  the  2-matching  problem  as  the  basic 
relaxation  of  the  TSP.  We  are  in  the  process  of  developing  such  an  algorithm 
for  the  symmetric  TSP. 
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